Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP - simplify continuation management to help future migration #8324

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

mcculls
Copy link
Contributor

@mcculls mcculls commented Feb 3, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mcculls mcculls added the tag: do not merge Do not merge changes label Feb 3, 2025
@pr-commenter
Copy link

pr-commenter bot commented Feb 3, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/simplify-continuations
git_commit_date 1738578316 1738584677
git_commit_sha 9af5347 5a01802
release_version 1.47.0-SNAPSHOT~9af5347cda 1.47.0-SNAPSHOT~5a01802146
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738587198 1738587198
ci_job_id 791029401 791029401
ci_pipeline_id 54703248 54703248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vgwv8dk-project-304-concurrent-0-c9bku60n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vgwv8dk-project-304-concurrent-0-c9bku60n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046543
Total [baseline] (10.398 s) : 0, 10397847
Agent [candidate] (1.052 s) : 0, 1051758
Total [candidate] (10.513 s) : 0, 10512963
section appsec
Agent [baseline] (1.183 s) : 0, 1183411
Total [baseline] (10.724 s) : 0, 10724394
Agent [candidate] (1.187 s) : 0, 1187293
Total [candidate] (10.767 s) : 0, 10766617
section iast
Agent [baseline] (1.17 s) : 0, 1169606
Total [baseline] (10.997 s) : 0, 10997037
Agent [candidate] (1.177 s) : 0, 1177200
Total [candidate] (10.939 s) : 0, 10939261
section profiling
Agent [baseline] (1.261 s) : 0, 1260753
Total [baseline] (10.808 s) : 0, 10807551
Agent [candidate] (1.285 s) : 0, 1285016
Total [candidate] (10.908 s) : 0, 10907693
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.183 s 136.868 ms (13.1%)
Agent iast 1.17 s 123.063 ms (11.8%)
Agent profiling 1.261 s 214.21 ms (20.5%)
Total tracing 10.398 s -
Total appsec 10.724 s 326.547 ms (3.1%)
Total iast 10.997 s 599.19 ms (5.8%)
Total profiling 10.808 s 409.705 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.187 s 135.535 ms (12.9%)
Agent iast 1.177 s 125.442 ms (11.9%)
Agent profiling 1.285 s 233.258 ms (22.2%)
Total tracing 10.513 s -
Total appsec 10.767 s 253.654 ms (2.4%)
Total iast 10.939 s 426.298 ms (4.1%)
Total profiling 10.908 s 394.73 ms (3.8%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.574 ms) : 0, 718574
BytebuddyAgent [candidate] (722.724 ms) : 0, 722724
GlobalTracer [baseline] (243.689 ms) : 0, 243689
GlobalTracer [candidate] (244.619 ms) : 0, 244619
AppSec [baseline] (55.511 ms) : 0, 55511
AppSec [candidate] (55.885 ms) : 0, 55885
Remote Config [baseline] (715.553 µs) : 0, 716
Remote Config [candidate] (729.226 µs) : 0, 729
Telemetry [baseline] (12.792 ms) : 0, 12792
Telemetry [candidate] (12.454 ms) : 0, 12454
section appsec
BytebuddyAgent [baseline] (732.057 ms) : 0, 732057
BytebuddyAgent [candidate] (734.634 ms) : 0, 734634
GlobalTracer [baseline] (240.009 ms) : 0, 240009
GlobalTracer [candidate] (240.757 ms) : 0, 240757
AppSec [baseline] (176.395 ms) : 0, 176395
AppSec [candidate] (176.78 ms) : 0, 176780
Remote Config [baseline] (698.475 µs) : 0, 698
Remote Config [candidate] (658.415 µs) : 0, 658
Telemetry [baseline] (8.245 ms) : 0, 8245
Telemetry [candidate] (8.308 ms) : 0, 8308
IAST [baseline] (21.628 ms) : 0, 21628
IAST [candidate] (21.847 ms) : 0, 21847
section iast
BytebuddyAgent [baseline] (832.05 ms) : 0, 832050
BytebuddyAgent [candidate] (838.915 ms) : 0, 838915
GlobalTracer [baseline] (233.469 ms) : 0, 233469
GlobalTracer [candidate] (234.04 ms) : 0, 234040
AppSec [baseline] (55.432 ms) : 0, 55432
AppSec [candidate] (53.074 ms) : 0, 53074
Remote Config [baseline] (614.946 µs) : 0, 615
Remote Config [candidate] (612.075 µs) : 0, 612
Telemetry [baseline] (8.707 ms) : 0, 8707
Telemetry [candidate] (8.805 ms) : 0, 8805
IAST [baseline] (24.086 ms) : 0, 24086
IAST [candidate] (26.435 ms) : 0, 26435
section profiling
ProfilingAgent [baseline] (95.452 ms) : 0, 95452
ProfilingAgent [candidate] (97.215 ms) : 0, 97215
BytebuddyAgent [baseline] (705.089 ms) : 0, 705089
BytebuddyAgent [candidate] (720.626 ms) : 0, 720626
GlobalTracer [baseline] (352.963 ms) : 0, 352963
GlobalTracer [candidate] (359.376 ms) : 0, 359376
AppSec [baseline] (55.215 ms) : 0, 55215
AppSec [candidate] (54.776 ms) : 0, 54776
Remote Config [baseline] (708.157 µs) : 0, 708
Remote Config [candidate] (778.139 µs) : 0, 778
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (9.018 ms) : 0, 9018
Profiling [baseline] (95.477 ms) : 0, 95477
Profiling [candidate] (97.239 ms) : 0, 97239
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040383
Total [baseline] (8.639 s) : 0, 8639356
Agent [candidate] (1.037 s) : 0, 1036812
Total [candidate] (8.623 s) : 0, 8622895
section iast
Agent [baseline] (1.172 s) : 0, 1171877
Total [baseline] (9.225 s) : 0, 9224635
Agent [candidate] (1.173 s) : 0, 1172865
Total [candidate] (9.23 s) : 0, 9230243
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.177 s) : 0, 1177303
Total [baseline] (9.221 s) : 0, 9220519
Agent [candidate] (1.17 s) : 0, 1169551
Total [candidate] (9.201 s) : 0, 9200509
section iast_TELEMETRY_OFF
Agent [baseline] (1.168 s) : 0, 1168149
Total [baseline] (9.212 s) : 0, 9212470
Agent [candidate] (1.184 s) : 0, 1183909
Total [candidate] (9.204 s) : 0, 9203631
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.172 s 131.494 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 136.92 ms (13.2%)
Agent iast_TELEMETRY_OFF 1.168 s 127.767 ms (12.3%)
Total tracing 8.639 s -
Total iast 9.225 s 585.279 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.221 s 581.163 ms (6.7%)
Total iast_TELEMETRY_OFF 9.212 s 573.114 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.173 s 136.052 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.17 s 132.739 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.184 s 147.097 ms (14.2%)
Total tracing 8.623 s -
Total iast 9.23 s 607.348 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.201 s 577.614 ms (6.7%)
Total iast_TELEMETRY_OFF 9.204 s 580.736 ms (6.7%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.946 ms) : 0, 713946
BytebuddyAgent [candidate] (712.734 ms) : 0, 712734
GlobalTracer [baseline] (242.141 ms) : 0, 242141
GlobalTracer [candidate] (241.799 ms) : 0, 241799
AppSec [baseline] (56.135 ms) : 0, 56135
AppSec [candidate] (55.079 ms) : 0, 55079
Remote Config [baseline] (728.719 µs) : 0, 729
Remote Config [candidate] (710.288 µs) : 0, 710
Telemetry [baseline] (12.236 ms) : 0, 12236
Telemetry [candidate] (11.357 ms) : 0, 11357
section iast
BytebuddyAgent [baseline] (833.862 ms) : 0, 833862
BytebuddyAgent [candidate] (834.569 ms) : 0, 834569
GlobalTracer [baseline] (233.762 ms) : 0, 233762
GlobalTracer [candidate] (234.414 ms) : 0, 234414
AppSec [baseline] (55.584 ms) : 0, 55584
AppSec [candidate] (53.7 ms) : 0, 53700
Remote Config [baseline] (625.961 µs) : 0, 626
Remote Config [candidate] (616.877 µs) : 0, 617
Telemetry [baseline] (8.719 ms) : 0, 8719
Telemetry [candidate] (8.645 ms) : 0, 8645
IAST [baseline] (24.095 ms) : 0, 24095
IAST [candidate] (25.659 ms) : 0, 25659
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.536 ms) : 0, 837536
BytebuddyAgent [candidate] (831.982 ms) : 0, 831982
GlobalTracer [baseline] (235.167 ms) : 0, 235167
GlobalTracer [candidate] (233.406 ms) : 0, 233406
AppSec [baseline] (54.151 ms) : 0, 54151
AppSec [candidate] (52.284 ms) : 0, 52284
Remote Config [baseline] (618.992 µs) : 0, 619
Remote Config [candidate] (608.554 µs) : 0, 609
Telemetry [baseline] (8.791 ms) : 0, 8791
Telemetry [candidate] (8.767 ms) : 0, 8767
IAST [baseline] (25.756 ms) : 0, 25756
IAST [candidate] (27.273 ms) : 0, 27273
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (830.862 ms) : 0, 830862
BytebuddyAgent [candidate] (843.255 ms) : 0, 843255
GlobalTracer [baseline] (233.464 ms) : 0, 233464
GlobalTracer [candidate] (236.7 ms) : 0, 236700
AppSec [baseline] (54.786 ms) : 0, 54786
AppSec [candidate] (53.966 ms) : 0, 53966
Remote Config [baseline] (617.759 µs) : 0, 618
Remote Config [candidate] (618.55 µs) : 0, 619
Telemetry [baseline] (8.632 ms) : 0, 8632
Telemetry [candidate] (8.589 ms) : 0, 8589
IAST [baseline] (24.489 ms) : 0, 24489
IAST [candidate] (25.295 ms) : 0, 25295
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-03T12:23:12 2025-02-03T12:30:14
git_branch master mcculls/simplify-continuations
git_commit_date 1738578316 1738584677
git_commit_sha 9af5347 5a01802
release_version 1.47.0-SNAPSHOT~9af5347cda 1.47.0-SNAPSHOT~5a01802146
start_time 2025-02-03T12:22:58 2025-02-03T12:30:00
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738586170 1738586170
ci_job_id 791029402 791029402
ci_pipeline_id 54703248 54703248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-yw9qwtww-project-304-concurrent-0-yo7q06kx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-yw9qwtww-project-304-concurrent-0-yo7q06kx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1332, 1371
.   : milestone, 1352,
appsec (1.74 ms) : 1716, 1763
.   : milestone, 1740,
appsec_no_iast (1.756 ms) : 1732, 1779
.   : milestone, 1756,
iast (1.504 ms) : 1480, 1528
.   : milestone, 1504,
profiling (1.501 ms) : 1477, 1525
.   : milestone, 1501,
tracing (1.482 ms) : 1457, 1507
.   : milestone, 1482,
section candidate
no_agent (1.353 ms) : 1333, 1373
.   : milestone, 1353,
appsec (1.749 ms) : 1725, 1773
.   : milestone, 1749,
appsec_no_iast (1.732 ms) : 1708, 1756
.   : milestone, 1732,
iast (1.492 ms) : 1467, 1516
.   : milestone, 1492,
profiling (1.488 ms) : 1465, 1512
.   : milestone, 1488,
tracing (1.496 ms) : 1472, 1520
.   : milestone, 1496,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.332 ms, 1.371 ms] -
appsec 1.74 ms [1.716 ms, 1.763 ms] 388.191 µs (28.7%)
appsec_no_iast 1.756 ms [1.732 ms, 1.779 ms] 404.129 µs (29.9%)
iast 1.504 ms [1.48 ms, 1.528 ms] 152.691 µs (11.3%)
profiling 1.501 ms [1.477 ms, 1.525 ms] 149.449 µs (11.1%)
tracing 1.482 ms [1.457 ms, 1.507 ms] 130.648 µs (9.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.333 ms, 1.373 ms] -
appsec 1.749 ms [1.725 ms, 1.773 ms] 396.546 µs (29.3%)
appsec_no_iast 1.732 ms [1.708 ms, 1.756 ms] 379.284 µs (28.0%)
iast 1.492 ms [1.467 ms, 1.516 ms] 138.839 µs (10.3%)
profiling 1.488 ms [1.465 ms, 1.512 ms] 135.571 µs (10.0%)
tracing 1.496 ms [1.472 ms, 1.52 ms] 143.108 µs (10.6%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.978 µs) : 359, 403
.   : milestone, 381,
iast (502.39 µs) : 480, 525
.   : milestone, 502,
iast_FULL (738.549 µs) : 717, 761
.   : milestone, 739,
iast_GLOBAL (552.561 µs) : 530, 575
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (506.258 µs) : 485, 528
.   : milestone, 506,
iast_INACTIVE (459.217 µs) : 438, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (496.602 µs) : 473, 520
.   : milestone, 497,
tracing (445.259 µs) : 424, 466
.   : milestone, 445,
section candidate
no_agent (379.928 µs) : 358, 402
.   : milestone, 380,
iast (500.061 µs) : 478, 522
.   : milestone, 500,
iast_FULL (736.303 µs) : 714, 759
.   : milestone, 736,
iast_GLOBAL (552.422 µs) : 530, 575
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (499.896 µs) : 478, 521
.   : milestone, 500,
iast_INACTIVE (455.354 µs) : 434, 477
.   : milestone, 455,
iast_TELEMETRY_OFF (498.649 µs) : 475, 522
.   : milestone, 499,
tracing (454.323 µs) : 433, 475
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.978 µs [358.978 µs, 402.977 µs] -
iast 502.39 µs [480.015 µs, 524.764 µs] 121.412 µs (31.9%)
iast_FULL 738.549 µs [716.588 µs, 760.51 µs] 357.571 µs (93.9%)
iast_GLOBAL 552.561 µs [529.951 µs, 575.172 µs] 171.584 µs (45.0%)
iast_HARDCODED_SECRET_DISABLED 506.258 µs [484.797 µs, 527.719 µs] 125.28 µs (32.9%)
iast_INACTIVE 459.217 µs [437.967 µs, 480.467 µs] 78.239 µs (20.5%)
iast_TELEMETRY_OFF 496.602 µs [473.483 µs, 519.722 µs] 115.625 µs (30.3%)
tracing 445.259 µs [424.299 µs, 466.219 µs] 64.282 µs (16.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.928 µs [358.302 µs, 401.555 µs] -
iast 500.061 µs [478.233 µs, 521.889 µs] 120.133 µs (31.6%)
iast_FULL 736.303 µs [714.069 µs, 758.538 µs] 356.375 µs (93.8%)
iast_GLOBAL 552.422 µs [530.265 µs, 574.579 µs] 172.494 µs (45.4%)
iast_HARDCODED_SECRET_DISABLED 499.896 µs [478.445 µs, 521.348 µs] 119.968 µs (31.6%)
iast_INACTIVE 455.354 µs [433.766 µs, 476.943 µs] 75.426 µs (19.9%)
iast_TELEMETRY_OFF 498.649 µs [475.101 µs, 522.197 µs] 118.721 µs (31.2%)
tracing 454.323 µs [433.241 µs, 475.405 µs] 74.395 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/simplify-continuations
git_commit_date 1738578316 1738584677
git_commit_sha 9af5347 5a01802
release_version 1.47.0-SNAPSHOT~9af5347cda 1.47.0-SNAPSHOT~5a01802146
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1738586738 1738586738
ci_job_id 791029403 791029403
ci_pipeline_id 54703248 54703248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vgwv8dk-project-304-concurrent-1-imaddbr1 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vgwv8dk-project-304-concurrent-1-imaddbr1 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.399 s) : 15399000, 15399000
.   : milestone, 15399000,
appsec (15.188 s) : 15188000, 15188000
.   : milestone, 15188000,
iast (18.546 s) : 18546000, 18546000
.   : milestone, 18546000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
.   : milestone, 18046000,
profiling (15.57 s) : 15570000, 15570000
.   : milestone, 15570000,
tracing (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
section candidate
no_agent (15.24 s) : 15240000, 15240000
.   : milestone, 15240000,
appsec (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
iast (18.868 s) : 18868000, 18868000
.   : milestone, 18868000,
iast_GLOBAL (17.897 s) : 17897000, 17897000
.   : milestone, 17897000,
profiling (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
tracing (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.399 s [15.399 s, 15.399 s] -
appsec 15.188 s [15.188 s, 15.188 s] -211.0 ms (-1.4%)
iast 18.546 s [18.546 s, 18.546 s] 3.147 s (20.4%)
iast_GLOBAL 18.046 s [18.046 s, 18.046 s] 2.647 s (17.2%)
profiling 15.57 s [15.57 s, 15.57 s] 171.0 ms (1.1%)
tracing 14.956 s [14.956 s, 14.956 s] -443.0 ms (-2.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.24 s [15.24 s, 15.24 s] -
appsec 15.224 s [15.224 s, 15.224 s] -16.0 ms (-0.1%)
iast 18.868 s [18.868 s, 18.868 s] 3.628 s (23.8%)
iast_GLOBAL 17.897 s [17.897 s, 17.897 s] 2.657 s (17.4%)
profiling 14.968 s [14.968 s, 14.968 s] -272.0 ms (-1.8%)
tracing 15.023 s [15.023 s, 15.023 s] -217.0 ms (-1.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5a01802146, baseline=1.47.0-SNAPSHOT~9af5347cda
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.463 ms) : 1452, 1475
.   : milestone, 1463,
appsec (2.347 ms) : 2304, 2390
.   : milestone, 2347,
iast (2.098 ms) : 2043, 2152
.   : milestone, 2098,
iast_GLOBAL (2.147 ms) : 2092, 2203
.   : milestone, 2147,
profiling (1.954 ms) : 1911, 1997
.   : milestone, 1954,
tracing (1.947 ms) : 1905, 1990
.   : milestone, 1947,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.36 ms) : 2317, 2403
.   : milestone, 2360,
iast (2.099 ms) : 2045, 2154
.   : milestone, 2099,
iast_GLOBAL (2.142 ms) : 2087, 2197
.   : milestone, 2142,
profiling (1.974 ms) : 1929, 2019
.   : milestone, 1974,
tracing (1.929 ms) : 1887, 1971
.   : milestone, 1929,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.475 ms] -
appsec 2.347 ms [2.304 ms, 2.39 ms] 883.648 µs (60.4%)
iast 2.098 ms [2.043 ms, 2.152 ms] 634.483 µs (43.4%)
iast_GLOBAL 2.147 ms [2.092 ms, 2.203 ms] 683.822 µs (46.7%)
profiling 1.954 ms [1.911 ms, 1.997 ms] 490.737 µs (33.5%)
tracing 1.947 ms [1.905 ms, 1.99 ms] 484.043 µs (33.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.36 ms [2.317 ms, 2.403 ms] 889.77 µs (60.5%)
iast 2.099 ms [2.045 ms, 2.154 ms] 629.066 µs (42.8%)
iast_GLOBAL 2.142 ms [2.087 ms, 2.197 ms] 671.843 µs (45.7%)
profiling 1.974 ms [1.929 ms, 2.019 ms] 503.886 µs (34.3%)
tracing 1.929 ms [1.887 ms, 1.971 ms] 458.817 µs (31.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: do not merge Do not merge changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant